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Abstract 

Ph , In this paper we prove necessary conditions for optimality of a stochastic control problem for a class of 

stochastic partial differential equations that is controlled through the boundary. This kind of problems can 

i-G ' be interpreted as a stochastic control problem for an evolution system in an Hilbert space. The regularity 

C^ , of the solution of the adjoint equation, that is a backward stochastic equation in infinite dimension, plays a 

crucial role in the formulation of the maximum principle. 

Key words. Stochastic control, maximum principle, stochastic evolution equation, backward 
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^ ■ 1 Introduction 

en 

I • I The maximum principle for stochastic control systems in infinite dimensions has been treated by 

f^ ■ Bensoussan in [1] using variational method. Then Hu and Peng in |12] studied general evolution 

OO , control systems where the operator is a generator of a Cq- semigroup, see also the bibliography 

^^ ' therein for the results in finite dimension and [13] for a stochastic systems of functional type. There 

have been then several exstensions, mainly dealing with finite dimensional systems and when dealing 
S^ . with SPDEs always considering diffused noise and control, for a comprehensive bibliography see 

H I [18]. The aim of our paper is to deal with control problems where the control and noise acts on the 

boundary that seem interesting from the point of view of applications. 

In particular we can consider the following Cauchy problem for the case of a stochastic heat 

equation 

d.y(^t,x) = :^v{t,x) + f{v{t,x)) + g{v{t,x))^Wit,x), t e [0,T], x S [0, 1] 

i:vit, 0) = uHt) + W\t), £uit, 1) = u\t) + W\t), (1.1) 

v{0,x) = u^{x), 

where g^VV(t,x) is a space-time white noise, {Wf,t > 0}, i = 1,2 are independent standard real 
Wiener processes, the unknown u{t,x,uj), representing the state of the system, is a real-valued 



process, the controls are two predictable real-valued processes u'^{t,x,u}), i = 1,2 acting at and 
1, and uq is a function defined on [0, 1]. 

This kind of systems can be rewritten as an evolution equation in an Hilbert space but to deal 
with the boundary terms one has to introduce unbounded terms in the equation. Indeed if one sets 
H = L^(0, 1) and A the realization of the Laplace operator in L^ with Neumann conditions one 
can write equation as 



n wriLC equaiiuii as 
r dXt = {AXt + F{Xt)) dt + {\- A)Dut dt + {\- A)Di dWt + G{Xt) dWt t G [0, T] 



(1.2) 



where A > belongs to the resolvent set of the operator A, that we will assume to be generator of 
an analytic semigroup and D and Di are maps that transform the boundary terms u and W into 
elements that belongs to the domain of fractional power of A — ^ so that the operators (A — A)D 
and (A — A)Di are the unbounded terms mentioned before and are enough regular to guarantee 
the existence of a mild solution of (II. 2p in the space H. 

A key point consists in proving that the solution to the adjoint equation is more regular and 
takes values in the domain of [(A — A)D]* so that we can formulate the maximum principle. 

Moreover we have to assume more regularity on the coefficients when we use the spike variation 
method, since it is seen that the rate of convergence of the first order approximations is e° with 
2 < a < 1. The lower bound ^ is imposed by the presence of a noisy boundary term, in this case 
we prove a maximum principle condition without introducing the second order approximation of 
the state unknown and the additional adjoint equation. 

When the control space is a convex set, clearly this problem does not occour since the ffist 
order approximation is of order e. 

The rest of the paper is organized as follows: in section 2 we provide notation and we state the 
problem in his abstract formulation specifying the hypotheses, in section 3 we study the adjoint 
equation that turns out to be a backward stochastic equation in the infinite dimensional space H, 
in section 4 we prove the maximum principle, while in the last section we provide two examples of 
application of our result. Notice that, exploiting the recent results of [8], we can deal with an heat 
equation with noisy boundary conditions of Dirichlet type. The drawback is that we have to work 
in an L^ space with weight and so we have to restrict the class of the cost functionals we can treat. 

2 Preliminaries and statement of the problem 

2.1 Notation 

Given a Banach space X, the norm of its elements x will be denoted by \x\x, or even by |3;| when 
no confusion is possible. If V is another Banach space, L{X, V) denotes the space of bounded linear 
operators from X to V, endowed with the usual operator norm. Finally we say that a mapping 
F : X ^ V belongs to the class Q^{X;V) if it is continuous. Gateaux differentiable on X, and 
V-F : X — >■ L{X, V) is strongly continuous. The letters H, H, K and U will always be used to 
denote Hilbert spaces. The scalar product is denoted (•,•), equipped with a subscript to specify 
the space, if necessary. All the Hilbert spaces are assumed to be real and separable; -L2(S,i7) is 
the space of Hilbert-Schmidt operators from H to H, respectively. 

Given an arbitrary but fixed time horizon T, we consider all stochastic processes as defined 
on subsets of the time interval [0,T]. Let Q G L{K) be a symmetric non-negative operator, not 



necessarily trace class and W = (W^t)te[o,T] be a Q- Wiener process with values in K, defined on 
a complete probability space ($7, J^, P) and W = {Wt)t£[o,T] be a cylindrical Wiener process with 
value in H, defined on the same probability space and independent of W. By {Tt, t G [0, T]} we 
will denote the natural filtration of (VF,W^), augmented with the family Af of P- null sets of J-", 
see for instance [3] for its definition. Obviously, the filtration (J"j) satisfies the usual conditions of 
right-continuity and completeness. All the concepts of measurability for stochastic processes will 
refer to this filtration. By V we denote the predictable cr-algebra on x [0, T] and by B{A) the 
Borel cr-algebra of any topological space A. 

Next we define two classes of stochastic processes with values in a Hilbert space V. 

• Lp{Q X [0, T]; V) denotes the space of equivalence classes of processes Y £ L'^{Q x [0, T]; V) 
admitting a predictable version. It is endowed with the norm 



Y\= E / WA^ds 



s\ 



1/2 



• Cp([t, T]; LP(r2; 5)), p € [l,-|-oo], t G [0, T], denotes the space of 5-valued processes Y such 
that Y : [t,T] -^ U'{Q,S) is continuous and Y has a predictable modification, endowed with 
the norm: 

\Y\^ — snn FIV 1^ 

Elements of C'p{[t, T]; L^{il.; S)) are identified up to modification. 

• For a given p > 2, Lj,{Q;C{[0,T];V)) denotes the space of predictable processes Y with 
continuous paths in V, such that the norm 

||y|lp = (E sup |y,n^/p 

sG[0,T] 

is finite. The elements of L^{Vt] C'([0, T]; V)) are identified up to indistinguishability. 

Given an element $ of L^(ri x [0,r]; L2(H, F)) or of L^(J] x [0,r]; ^2(1^, F)), the Ito stochas- 
tic integrals Jq (^{s)dW{s) and Jq (^{s) dW{s), t G [0,T], are F-valued martingales belonging to 
Lp(0; C([0, T]; V)). The previous definitions have obvious extensions to processes defined on subin- 
tervals of [0, T] or defined on the entire positive real line W^ . 

2.2 The optimal control problem and the state equation 

Let ff be a separable real Hilbert space, and U a separable Hilbert, called the space of controls. 
Let Uad a non empty set of U . We set the space L'^{Q. x [0, T]; Uad) the space of admissible controls, 
and we denote it hy U. 
We make the following, assumptions that we denote by (A): 

(A.l) A : D[A) C H —^ H is a linear, unbounded operators that generate a Co-semigroup that is 
also analytic, {e*^}j>o such that \e''^\L{H,H) < Afe"^*, t > for some M > and w G M. This 
means in particular that every A > a; belongs to the resolvent set of A. 



(A. 2) F -.R^ X H ^ H, G ■.R'^ X H ^ L{E, H), are measurable functions such that for h = F,G, 
t — >• h{t, X, y) is continuous for every fixed x £ H,y (^ K. Furthermore, there are constants L, 
K andj € [0, l/2[ such that: 



\F{t,x) -F{t,u)\K < L\x-u\h 

\e'^[G{t,x) - G(t,n)]U,(H,H) < (^7^1^ " ^1^' 

\F{t,0)\K<K, 

for every x,u £ H and s^t £ IR+. 
(A.3) F(t,-) G g\H;H); for every s > 0, e"^G(t, •) G g\H;L2{E,H)) and 



|e^^[G,(t,x)-G,.(t,n)]U,(E,H)<7Y^I^-^lH, (2.1) 



for every x,y G H; 

(A. 4) There exists a continuous linear operator D : U ^ D{{X — A)'^) for some 2 < ct < 1 and 
X > u, see for instance [16] or [T7j for the definition of the fractional power of the operator A. 

(A. 5) There exists a linear operator Di : U ^ H and there is a constant < /3 < 2 such that the 
following holds: 

for some A > 0. 



We consider in the Hilbert space H the stochastic differential equation for the unknown process 

Xt, tG[0,r]: 

' dXt = {AXt + F{Xt)) dt + iX- A)Dut dt + {X- A)Di dWt + G{Xt) dWt t G [0, T] 

As usual, see also [1], we mean by mild solution to this equation a (J-'t)- predictable process Xt, t G 
[0, T] with continuous path in H such that V- a.s. 

Xi = e*^x+ / e^^-'^'^F{s,Xs))ds+ [ e^^-'^'^iX - A)Dusds 
Jo Jo 

+ f e^^-'^'^{X-A)DidWs+ I e^*-'^^G{s,Xs)dWs, tG [0,r] 
JO Jo 



Proposition 2.1 Under the assumptions (A), for every u ^U there exists a unique process X G 
C-p([0, T]; L^(r2; i?)) mild solution of equation (j2.2p . 



Proof. The only point to check in order to perform the fixed point argument, see[l], theorem 
7.6, or [9], proposition 3.2, is that processes (/q e^*~^^^{X — A)Dusds)t;^[Q^T] and (Jg e(*~*^'^(A — 
A)DidWs)t£[o.T] belongs to the space C'p{[0,T];L'^{O,;H)). We have indeed: 



Moreover: 



sup E 

te[o,T] 



sup E 

te[o,T] 



.it-s)A 



{XI - A)Dus ds 



<Cri-2a]g / \u^\'ids <+oo 
Jo 



f 

Jo 



,{t-s)A( 



e- ^'-{XI - A)DidWs 



< E 



T 



s-'^ds 



< +00 



where both C and K are positive constants that depends on T and the costants defined in (A), n 
We associate to this state equation the following cost functional: 



J{x, u)=E I l{t, Xt,ut) dt + EhiXr) 
Jo 



(2.3) 



where / and h verify (B): 

(B.l) (i) I : [0,T] X // X [/ ^- M is measurable and there exist a constant L > and a modulus of 
continuity w : [0, +oo) -^ [0,+oo), such that: 



\l{t,x,u) -l{t,x',u')\ < {L\x -x'\ +u){\\u-u'\\u)) 

for all t G [0, T], x,x' G H and u, u' € U. 

(ii) Moreover for ah t G [0,r] and all u e U l{t, •,n) € g^{H;R) such that 

\lxit, X, u) — lx{t, x' , u)\ < L\x — x'\ 

for all t G [0, T], x,x' e H and u eU. 
(B.2) (i) h : H ^ M, is measurable and there exist a constant L > such that 

\h{x) -h{x')\ <L\x-x'\ 

for all X, x' € H. 

(ii) Moreover h € g^{H;R) and 

\hx{x) — hx{x')\ < L\x — x'\ 



(2.4) 



(2.5) 



(2.6) 



(2.7) 



for all X, x' E H. 

The optimal control problem consists in minimizing J over all n G Z^. 

We will seek for necessary conditions fulfilled by an optimal couple, whenever it exists, {X, u) G 
Cr{[0,T];L'^{n;H)) x ^/ such that 



inf J{x, u)=E l{t, Xt,ut) dt + E/i(Xt) 
ueu Jq 

where X is the mild solution to: 

dXt = (AXt + F{Xt)) dt + iX- A)Dut dt + {X- A)Di dWt + G{Xt) dWt t G [0, T] 
Xn = X 



(2.8) 



(2.9) 



3 Regularity results for the Adjoint equation 

In this section we consider the following backward stochastic differential equation, the so-called 
adjoint equation: 

-dYt = [A^Yt + F,{t, Xt)^Yt) dt + G,{t, XtfZt dt - l,{t, Xt,ut) dt - Zt dWt t e [0, T] 

Yt = -K{Xt) 

(3.1) 
Thanks to hypotheses (A) on the derivatives F^ and Gx and hypotheses (B) on the derivatives Ix 
and hx this equation is affine with uniformly bounded coefficients (in the linear part) and integrable 
forcing term and integrable final data. The generator A is an unbounded operator but generates a 
Co-semigroup, so the solution in Lj,{VL; C([0, T]; H)) x -Lp([0, T] x il; L2(H, H)) to this equation is a 
well known result, see [11] , It remains to prove an extra regularity property for the Y component. 

Proposition 3.1 Under assumptions (A) and (B) there exists a unique mild solution {Y, Z) in 
L^(il;C([0,r];F)) X L^([0,r] x n;L2{E,H)). Moreover for every t G [0,r[ andF-a.s., Yt{uj) 
belongs to the domain of DA . 

Proof. The mild solution exists by [TT], theorem 3.1 or [14], theorem 4.4 that is a couple {Y,Z) 
mL^{n;C{[0,T];H)) x Ll{[0,T] xn;L2{E,H)) such that: 

r-T 



Yt = -e(^-*)^^/i,(XT) + I e^'-'^^\Fx{s,X,fY, + Gx{s.X,Yz,) ds 

-/ e(^-*)^^/,(s,X,n.)ds- / e^'-'^'^^ZsdWs, t G [0,T] 
Jt Jt 



Let us now prove the regularity result. We have: 



Yt = E^'Yt = - e(^-*)^^E-^*/i,(XT) + J e('^-*)^^E^^(F,(s,X)^y, + Gx{s,XsfZs) ds 

f-T 

+ e(^-*)^^E-^'/,(s,X„n,)ds (3.2) 

We have to evaluate \\D'^ A^Yt\\u = sup„g[/||„||=i(L'^^'^Ft,'u)[/ = svLY)u(iu,\\u\\=i0^t,ADu)u- We 
have: 

|(E-^'/i,(XT),^e(^-*)^Z)tx)l < E-^*|/i,(XT)Pe(^-*)^Dn| < _^ „ J l + E^^|Xt|); 



^E-^'(|n| + |Z,|) , 

—, n "■5 

(s-t)i-° 



/ {W.^\Fx{s,XsfYs + Gx{s,Xsf Zs),Ae^'-'^^Du) ds\ <G I 
Jt Jt 

<C( I (E^*mP+E-^'|Z,|2)dsy V^"-!; 

r^ - r^ G - 

\ {E^Hx{s,X„Us),Ae^'-'^^Du)ds\< {I + E^'\Xs\ + E^'\us\)ds 



<G{ I (l + E-^*|X,|2 + E-^*|n,|2)(isV^V°-^ 



This implies that for some constant C > that depends on T and the quantities defined in (A) 
and (B): 



El 



\D'^A^Yt\\u< ,^ ^M„^ (l+ sup E|Xj|2 + E sup \Yt? ^^ \ \Ztfdt)<^oo. 
[^ - *J ie[o,T] te[o,T] Jo 



n 



4 The Maximum Principle 

4.1 Variation of the trajectory 

Let {X,u) be an optimal couple of problem (|2.2p and (j2.8p . Fix f £ Uad and t G [0,^] and for 
every < e < T — f define 

' V teE,:= [t,i+e]; 



(4.2) 



"'^*) - 1 u{t) t i E, 
Let us consider the following equations: 

dXI = {AXI + F{XI)) dt + {\- A)Dul dt + {X- A)Di dWt + G{Xf) dWt t € [0, T] 
X^ = x 



and 



dXf = {AXf + F^{t, Xt)Xf) dt + {X- A)D{ul - ut) dt + G^{t, Xt)Xf dWt t G [0, T] 



X§ = 



(4.3) 



We have: 

Proposition 4.1 Under hypothesis (A) for every e > there exist a unique mild solution X^ G 
C-p([0, r];L^(Q;i^)) of equation (j4.2|) and a unique solution X'' G C-p([0, T]; L^(il; //)) of equation 
()4.3p . Moreover for all p > 1 ; 

E sup jXf|P<+oo. (4.4) 

tG[0,T] 

Proof. The existence and uniqueness of the solutions are guaranteed by theorem 7.6 of [3]. Let us 
now prove (|4.4p . We have 



Xf= [ e^'-'^^F^{Xs)Xlds+ I e^'-''^^G^{Xs)XldWs+ f e^'-''^^{XI - A)D{ 
Jo Jo Jo 



so 



E sup \Xf\P < c{p) 

0<t<r 



E sup 

■ 0<t<r 

+ E sup 

0<t<r 



e(*-^)^F,(X)^ftis 



+ E sup 

0<t<r 



ul — Us) ds 



e^'-'^'^aXsW.dWs 



e{t-^)^(A/ _ A)D{ul - Us) ds ' < c{p)[h + h + k 



For Ii we have, thanks to hypoteses (A.l) and (A. 2) there exists a constant C depending on T, 
p and the quantities in (A) such that: 



/i<CEsup / sup \X'\Pds<C E sup jX^l^ds 

0<t<rJo 0<a<s JQ 0<a<s 

Then, having that \Ae^^~^> D\i(ij^h-^ < .^_?i„„ for soma costant C > 0, thanks to (A. 4) we have 



h<cp 



1 \p 

ds] =CPT''P 



,1-a 



Eventually to treat term I2 we use the factorization method, see [3]. Take p > 2 and p € (0, 1) such 
that i < p < i - 7, and let c'^ = J^{t - a)P-^{a - s)-Pda. Hence 



/2 = E sup 

0<t<r 



E sup 

0<t<r 



f e^'-'^^G,{Xs)XldWs 
Jo 



e(<— )^(i _ ^)P-i da \ / e("-^)^(cj - syPG^{X,)Xl dW, 



<E sup ( / (t-a)(''-i)''^^^^ 



0<t<r ^ JO 



e(--)^(^ _ s)-PG^{Xs)XI dWs 



da 



^ Jo 



,P/2 



<C I U {a - sy^'-P+^UsY E sup \K\Pda. 



0<s<a 



for some constant C > 0, depending on T, p and the parameter defined in (A). 
So combining all these estimates together, we obtain that 



0<«r- 



E sup \Xf\P<C I E sup \X^JP ds + \v\P^T"'P . 



0<a<s 



Thus by Gronwall theorem we can conclude. 
We claim that: 

Proposition 4.2 Under hypothesis (A) there is a constant 5 > independent of e such that: 



n 



A^ := sup E sup \Xf - Xt\ < fe" (4.5) 



m>l 0<t<T 



Proof. We have that: 

d{Xf - Xt) = [A{Xf - Xt) + F{t, Xf) - F{t, Xt)] dt + {X- A)D{ul - ut) dt 

+(G(t, XI) - G{t, Xt) dWt, t G [0, T] (4.6) 

Xg - Xo = 

Follwing proposition 14. 1^ we have for p > 2 : 



E sup \XI -Xt\P <C 

t£[0,r] 



E sup \X^-X„\Pds+ sup . , 
o-G[0,s] ie[o,T]^Jt {i - s) 



t+e 



v\u , \P' 
ds 



l-Q 



where C as usual is independent of e and m and it is function oi T, p, \v\u and the quantities 
introduced in (A). Therefore by Gronwall lemma we can conclude. D We set 

rjt:=X!-Xt-Xt, 
and we end the section with the following result 
Proposition 4.3 Under hypothesis (A) there is a constant 5i > independent of e such that: 



Aie:=supE sup \r]^\ < 6e 
m>l o<i<r 



2o 



(4.7) 



Proof. We have: 



' dr]l = d{Xl - Xl^ - XI) = Ar]l dt + F^{X'^)r]l dt + G^(Xf*)r/f dWt 
1 



+ 



+ 



■-^0 



(F.(t, xr + e{xt - xD) - FAxrm^t - ^n de 
iG,it,xr + eix^ - xn) - G.{xn){xi - xn de 



dt 
dt, 



(4.8) 



Xo--Xo- = 



Notice that, thanks to (A. 3), we have that for some 7 € [0, i[ 



L 



|e^^[G^(t,2;)-G^.(i,n)]|i2(s,^) < ———-\x-u\h 
for every x,y a H and s € M+. Thus for every p > 2, as in proposition 14. H we obtain that 



E sup \r]l\P < C 

tG[0,r] 



E sup \Xl-X„\^P 
'- o-e[o,T] 



E sup \r}l\^ ds 

(tG[0,s] 



and we conclude. 



n 



4.2 Main result 

Now we are able to state and prove the Maximum Principle for our optimal control problem. 

Theorem 4.4 Assume hypotheses (A) and (B). Let {X,u) and optimal pair of Problem (j2.8p and 
(HJD. Then there exists a unique solution (Y, Z) G L|,(il; C([0, T]; i7)) x L'^{[0,T] x Q.;L2{r.,H)) 
of equation (j3.ip and 



H{t,Xt,ut,Yt)>H{t,Xt,v,Yt), yueUad, a.e. t £ [0,T], F - a.s. 



(4.9) 



where 



H{t,x,v,p) := {D*{X-A)*p,v)H-l{t,x,v), {t,x,v,p) e [0,T]xHxUadxD{D*{X-A)*), X > u 



Proof. Since {X,u) is optimal for every e > and x (z H we have: 



0<J{x,Ue)-Jix,u) =E [ {l{t,Xf ,ul) - l{t,Xt,ut)) dt + E{h{X^) - hiXr)) = h + h- 

Jo 



Let us considet Ii, adding and substractiong we get: 

fT rT 

E 



/ {l{t,X!,ut)-l{t,Xt,ut))dt = E [ {l{t,Xt,ul)-l{t,Xt,ul))dt 
Jo Jo 

+ E [ {l{t, Xt,ul) - l{t, Xt,ut)) dt = Ji + J2 
Jo 

Let us concentrate on Ji, we have, thanks to propositions 14.21 and 14.31 : 

E [ {l{t,Xt,ul)-l{t,Xt,ul))dt = 
Jo 

E I f Mt, Xt + 9{Xf - Xt), ul) - Ut, Xun^Xl - Xt) dO dt+ 
Jo Jo 

E I [Ut,Xt,ul) -Ut,Xt,ut)]{Xt - Xt) dt + E [ Ut,Xt,ut)7]ldt+ 
Jo Jo 

E / Ut, Xu ut)Xl dt < Ce^" + E / /,(i, Xt,nt)Xf dt 
Jo Jo 

Combining aU these relations we end up with: 

E / {l{t,Xf,ut)-l{t,Xt,ut))dt<Ce^'' + E [ l,{t,Xt,ut)Xf dt + E [ {l{t,Xt,uf) - l{t,Xt,ut)) dt. 
Jo Jo Jo 

Similarly we get: 

Eh{X^) - EhiXr) < Ce^" + Eh^{XT)X^ 
and thus: 

E [ {l{t, XI, ul) - l{t, Xt,ut)) dt + Eh{X^) - EhiXr) 
Jo 

< Ce2- + E [ l,{t, Xt,ut)Xf dt + E/i,(Xt)1^ + E / {l{t, Xt,ut) - l{t, XuUt)) dt 
Jo Jo 

Now, computing d{Xf,Yt), solutions respectively of equations (j4.3p and (|3.ip we obtain: 

-E(1|.,/i,(Xt))=E / l,{t,Xt,ut)X^dt + E [ {AD{ut-ut),Yt)dt 
Jo Jo 



Therefore: 

rT 



0<J{x,u'')-J{x,u)=E I {l{t,X^,uf)-l{t,Xt,ut))dt + Eh{X^)-Eh{XT) 

Jo 

t-t+e r-t+e 

<C7e2" + E/ {{ut-v),D*{\-A)*Yt)dt + E {l{t,Xt,v) - l{t,Xt,ut))dt 

Jt Jt 



Then dividing by e and recalling that a > 2, using a localization procedure, see [2], and exploiting 
the continuity of I we can conclude. D 

10 



4.3 The case when Uad is a convex set 

In this paragraph we assume that the non empty subset Uad is a convex set. The space U of 
admissible controls and the optimal control problem are the same. 
Besides (A.l) - (A. 4) - (A. 5) we assume (C): 

(C.l) F :R~^ X H ^ H, G -.R^ X H ^ L{E, H), are measurable functions such that for h = F,G, 
t — > h{t,x) is continuous for every fixed x £ H. Moreover F{t,-) £ Q^{H;H); for every 
s,t>0, e^^Git, •) G G^iH; -^2(5, H)) and there is a constant K > and ^ £[0,^[ such that: 



\F^{t,x)\K<K 

{lAsp'' 



|e^^G.(t,x)|^,(=H)<7Y^, (4.10) 



for every x £ H and every s,t £ M"*"; 

(C.2) For all t € [0,T] and aU u £ U, l{t,-,u) £ g^{H;R) and for ah t £ [0,T] and ah x £ H, 
l{t,x, •) £ G^iU]R) and there is a constant K > such that: 

\lx{t,x,u)\ + \lu{t,x,u)\ < K{1 + \x\h + \u\u) (4.11) 

for all t£ [0, T], x£ H and u£U. 
(C.3) h £ Q^{H;R) and there is a constant K > such that: 

\h,ix)\<K{l + \x\H) (4.12) 

for all x £ H. 

We have the following variational inequality. 

Lemma 4.5 The cost functional J is Gateaux- dijjerentiable and the following variational inequality 
holds: 

-^Jiui-) + 9v{-))\e=o = Kh,iXT)XT + K f Ms,Xs,Us)X, + Us,Xs,Us)vs]ds >0 (4.13) 

where v £ Lj,{{0,T);U) satisfies u{-) + v{-) £ U, and X is the solution to the following linear 
equation: 

Xt= I e^^'-''^F,{s,Xs)Xsds+ I e^^'-'^G,,{s,Xs)XsdWs+ I {\-A)Dvtdt (4.14) 

Jo Jo Jo 



Proof. The proof is similar to |12] . 

n 

It is clear that the results of Proposition 3.1 still hold under these hypothesess, so we can assert 
the maximum principle: 
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Theorem 4.6 Let {u,X) be an optimal pair the problem (j2.8p and (j2.2p . Then there exists a 
unique pair {Y, Z) € Lp(il; C([0, T]; //)) xL|,([0,T] x^]L2{'^,H)) solution of equation ()3.ip siic/i 

(i/„(t,Xt,ut,yt),v-ut)<0, V7;GC/arf, a.e. tE[0,r], P-a.s. (4.15) 

w/iere 

H{t,x,u,p) := (Z)*(A-^)*p,M)H-/(t,x,M), (t,x,u,p) € [0,T]xHxUad^D{D*{X-A)*), \ > lo 

Proof. Prom (j4.13p we have that: 

E{h^{XT),XT)+E [ {Us,Xs,Us),Xs) + {luis,Xs,Us),Vs)ds>0 (4.16) 

Jo 

for every v € L|,((0,T); [/) satisfies 'u(-) + v{-) € Z// and X is the solution to (14.141) . Moreover 
evaluating jg d{Yt,Xt) dt, we get that: 

- K{h,{XT),XT) - E / {l,{s, X,,Us),Xs) = E / (n, (A - A)Dvs) ds (4.17) 

Jo Jo 

Thus combining ()4.16p and ()4.17p we end up with: 

E / {Us,X„Us),Vs)ds>E [ {D*{X-A)*Y„Vs)ds 
Jo Jo 

Thus using a localization procedure, see [2], we can conclude chosing vt = v — ut, with v € Uad- □ 

5 Applications 

We provide two examples to which our result apply. 

5.1 Example 1 

Let us consider the following problem: 

^ d.y{t,x) = ^yit,x) + f{y{t,x))+g{yit,x))^W{t,x), t € [0, T], x € [0, 1] 

i:y{t, 0) = uHt) + W^t), i:y{t, 1) = u^{t) + W\t), (5.1) 

, u{0,x) = u^{x), 

where g^>V(t, x) is a space-time white noise, {VF/,i > 0}, z = 1,2 are independent standard 
real Wiener processes, the unknown y(t, x, tj), representing the state of the system, is a real- valued 
process, the controls are two predictable real- valued processes u*(t, j;,a;), i = 1,2 acting at and 1 
and having values in {—1, 0, 1}; uq € L'^{0, 1)- We assume that / and g are C^'^(M). 

Now we write (|5.ip as an evolution equation in the space H = L^(0, 1). This is done in [5], see 
also bibliography therein and [7]- We define the operator A in H hy setting 

D{A) = {ye H\0, 1) : ^y(O) = ^y(l) = 0}, Ay{x) = ^y(x), for y G D{A). 
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Moreover for every A > 0, 



D((A-A)") = F^"(0,1 



for < a < -. 

4 



For every fixed A > there exists d* E //^"(0, 1), see for instance [7] that solves the following 
Neumann problems: 



dx' 



■d'{x) = \d\x), X G [0,1], i = 1,2 



fj\Q) = l, i:dHl) = 0, 



(5.2) 



i:d^{0)=0, 



IdHl) = 1. 



Thus we set U = K = M? and Uad = {—1)0,1} x {—1,0,1}, the covariance matrix Q = I and 
D = £)! : M2 ^ D{{X - A)°), such that Du{t){x) = d^{x)u^{t) + d'^{x)u^{t) and DW{t){x) = 
d^{x)W^ + d^(x)TVj?. We set E = L^(0, 1) and ^VV(t, •) = W{t) is a cylindrical Wiener process in 
S = L^([0, 1]), see for instance 0]. 

We finally set Xt = y{t, •) and F{^){-) = /(^(•)) and G(0(-) = 9{^{-)) for aU ^ G ii', then system 
(15.11) can be written as 



dXt = (AXt + F{Xt)) dt + {X- A)Dut dt + {\- A)Di dWt + G{Xt) dWt t G [0, T] 
Xo = uo 



(5.3) 



It is then easy to show that all hypotheses (A) are fulfilled, note that we can chose a > g- Let us 
introduce the following finite horizon cost 

J{x,u\-),u'^{-)) = E / l{y{s,x),u\s),u'^{s))dxds + E h{y{T,x))dx. 
Jo Jo Jo 

with l(x, u^,u'^) : R X M X R — >■ R, continuous and derivable, with bounded and Lipschitz continuous 
derivatives in x uniformly with respect to u^^u^ and Lipschitz continuous with respect to {v},v?') 
uniformly with respect to x. Moreover we assume h G C^'^(R). We set: 

l{i,u^,u^)= I \{i{x),u^,u'^)dx, for CeH,u^,u'^ eU 
Jo 

h{^) = [ h(C(x)) dx, for CeH. 
Jo 

Hence also hypothesis (B) is fulfilled and theorem 14.41 holds. 

5.2 Example 2 

Now we consider a boundary control problem for a stochastic heat equation with Dirichlet condition 
perturbed by a stochastic process. More precisely we have: 



^ |t;(t, x) = ^v{t, x) + f{v{t, x)), t G [0, T], X G [0, +oo) 

v{t,0)=u{t) + W{t), 
, v{0,x) = v^{x), 



(5.4) 
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where {Wt, t > 0}, is a standard real Wiener process, the unknown v{t, x, uj), representing the state 
of the system, is a real-valued process, the controls is a predictable real-valued process u{t,x,uj), 
acting at 0; v^ € -^^(0, 1). We assume that / is C^(M) with bounded derivative, and clearly g = 0. 
It is well known that it is not possible to rewrite the Cauchy problem (j5.4p as an evolution equation 
in the space L'^{0, +oo), see 0. In [15] it is shown that the Dirichlet map takes values in the domain 
of {—A)°', for a certain a > ^, when it is considered in the Hilbert space L^{0, +oo; {p^^^ A 1) dp). 
More precisely if we set H = L^(0, -|-oo; {p^~^^ A 1) dp), the operator ^o that is the realization of 
the Laplacian with Dirichlet conditions in L^(0, +oo) extends to an operator A that generates an 
analytic operatorin H. 

For every fixed A > there exists d^ ^ D{{X — A)°')) for some a > 2' 



^d{x) = \d{x), x>0 



dHO) = l, 



(5.5) 



Thus we set U = Uad = K = '^, the covariance matrix Q = 1 and Z? = D^ : M^ ^ ^((A - ^)°)), 
such that Du{t){x) = d{x)u{t) and DW{t){x) = d{x)Wt. We finally set Xt = v{t, •) and F{^){-) = 
/{£,{')) for all ^ € -ff, then system (15.4p can be written as an evolution equation in H. 

We assume the cost functional is of the following form: 

r+00 
l{^,u)= / {xAl)^+'^l{C{x),u)dx, fov^eH,ueU 
Jo 



/• + 00 

h{0 = {xA l)^+\{^{x)) dx, for ^£H. 

Jo 



Where 1 : R x M ^^ M is continuous and derivable with continuous derivarives with sublinear growth 
and h is derivable with the derivative with sublinear growth. Thus theorem 14.61 holds. 
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